Mc doc #985
Open
Mc doc #985
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
split tera.h to several roles baidu#964
| @@ -0,0 +1,33 @@ | |||
| #compact优化——多线程compact | |||
caijieming-ng
force-pushed
the
mc-doc
branch
2 times, most recently
from
ea9bb1c to
3c93f2a
Compare
|
文件名改一下吧，multi_thread范围太大了，重点应该是compact |
|
build |
| #compact优化——多线程compact | ||
| ##背景 | ||
|
|
||
| leveldb的compact策略是采用单线程执行的，顺序的读写逻辑减少了磁盘抖动，有利于发挥单机的机械磁盘的高效顺序读写性能。而类似rocksdb和tera的使用场景，底层直接使用ssd或使用ssd做本地cache或使用分布式文件系统，突破了机械磁盘的限制，在这种场景下，tera目前仍然使用levelbd的单线程模型做compact，业务的写热点很容易导致写入失败。因此本次实现多线程compact，充分利用底层存储带宽，提升compact性能，保证写分裂前，不会因为写热点导致写失败。 |
There was a problem hiding this comment.
磁盘抖动是啥。。大致明白你意思，不过好像没这个专业术语？
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
#976